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Abstract. Big g- Jacobi functions are eigenfunctions of a second order g-diffcrcnce op- 
erator L. We study L as an unbounded self-adjoint operator on an L 2 -space of functions 
on K with a discrete measure. We describe explicitly the spectral decomposition of L 
using an integral transform T with two different big Jacobi functions as a kernel, and 
we construct the inverse of T. 



1. Introduction 

Integral transforms with a hypergeometric function as a kernel have been the subject of 
many papers in the literature. A famous example is the Jacobi transform, first studied by 
Weyl [18] . which is an integral transform with a certain 2-Fi-function, the Jacobi function, 
as a kernel. The inverse of the Jacobi transform can be obtained from spectral analysis of 
the hypergeometric differential operator D, which is an unbounded self-adjoint operator 
on a weighted L 2 -space of functions on [0, oo). We refer to [14] for a survey on Jacobi 
functions. In a recent paper [IB] Neretin studied the hypergeometric differential operator 
D as a self-adjoint operator on a weighted L 2 -space of functions on R. In this setting the 
spectral analysis of D leads to an integral transform with two different Jacobi functions 
(vector-valued Jacobi functions) as a kernel, corresponding to the multiplicity two of the 
continuous spectrum. 

In this paper we obtain a g-analogue of Neretin's vector-valued Jacobi transform (or 
double index hypergeometric transform). There exist several g-analogues of Jacobi func- 
tions, namely the little and big q- Jacobi functions and the Askey- Wilson functions, see 
[H], [ID], [12], [IS]- Here we consider the big q- Jacobi function, which is a basic hyper- 
geometric 302-function that is the kernel in the big q- Jacobi transform by Koelink and 
Stokman [13]. The big q- Jacobi transform and its inverse arise from spectral analysis 
of a second order g-difference operator L, that is an unbounded self-adjoint operator on 
an L 2 -space consisting of square integrable functions with respect to a discrete measure 
on [— 1, oo). In this paper we study the same g-difference operator L as an unbounded 
self-adjoint operator on a different Hilbert space, namely an L 2 -space of functions on R 
with a discrete measure. The continuous spectrum of L has multiplicity two, thus leading 
to an integral transform pair with two different big q- Jacobi functions as a kernel. We 
call this the vector-valued big q- Jacobi transform. 

The vector-valued Jacobi transform has an interpretation in the representation the- 
ory of Lie algebra su(l, 1) (or equivalently sl(2,R)) as follows, see [El Section 4]. The 
hypergeometric differential operator D arises from a suitable restriction of the Casimir 
operator in the tensor product of two principal unitary series. The spectral analysis of 
D now gives the decomposition into irreducible representations, and the vector-valued 
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Jacobi transform can be used to construct explicitly the intertwiner for these representa- 
tions. The multiplicity two of the continuous spectrum corresponds to the multiplicity of 
the principal unitary series occurring in the decomposition, see [T7j, [15] for the precise de- 
composition. There is a similar interpretation of the vector-valued big q- Jacobi transform 
in the representation theory of the quantized universal enveloping algebra U q (su(l,l)). 
However, the corresponding representation is no longer a tensor product representation, 
but a sum of two tensor products of principal unitary series. This will be the subject of 
a future paper. 

The big q- Jacobi functions are nonpolynomial extensions of the big q- Jacobi polyno- 
mials [1J, but they can also be considered as extensions of the continuous dual g _1 -Hahn 
polynomials, see [13]. In this light, the vector- valued big q- Jacobi transform may also be 
considered as a g-analogue of the integral transform corresponding to the 3_F2-functions 
(Hn , Hn ) from [16, Thm.1.3], and of the continuous Hahn transform from [7j. In both 
transforms the kernel consists of two 3 ^-functions that are extensions of the continuous 
dual Hahn polynomials. 

The organization of this paper is as follows. In Section [5] we introduce the second order 
g-difference operator L and a weighted L 2 -space of functions on R 9 , a g-analogue of the 
real line. The difference operator L is an unbounded operator on this L 2 -space. We define 
the Casorati determinant, a difference analogue of the Wronskian, and with the Casorati 
determinant we determine a dense domain on which L is self-adjoint. In section [3j we 
introduce the big q- Jacobi functions as eigenfunctions of L given by a specific 302-series. 
We also give the asymptotic solutions, which are 302-series with nice asymptotic behavior 
at +00 or —00. A crucial point here is the fact that all eigenfunctions that we consider can 
uniquely be extended to functions on R 5 . In Section [4] we define the Green kernel using 
the asymptotic solutions and we determine the spectral decomposition for L. In Section 
5 we define the vector-valued big q- Jacobi transform J 7 , and we determine its inverse. A 
left inverse Q of T follows immediately from the spectral analysis done in Section HI To 
show that Q is also a right inverse, we use a classical method that essentially comes down 
to approximating with the Fourier transform. Finally, in the appendix two lemmas are 
proved which involve rather long computations. 

Notations. We use standard notations for g-shifted factorials, ^-functions and basic 
hypergeometric series [5]. We fix a number q e (0, 1). The g-shifted factorials are defined 
by 

(x; q)oo = 1^(1 - xq k ) } (x; q) n = , n G Z. 

The (normalized) Jacobi ^-function is defined by 

9(x) = (x, q/x; q)^, x £ q z . 

From this definition it follows that the ^-function satisfies 

9(x) = 9(q/x) = —x9(qx) = —x9{l/x). 

We often use these identities without mentioning them. For products of g-shifted factorials 
and products of ^-functions we use the shorthand notations 

(xi, x 2 , ■ ■ ■ , x k ; q) n = (xi, g)„(x 2 ; ?)„••• {x k ; g) n , n E Z U {00}, 

9(xx, x 2 ,..., x k ) = 9(x 1 )9(x 2 ) ■ ■ ■ 9(x k ), 
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and 

(xy ±x ; q) x = (xy, x/y; q)^, 6(xy ±l ) = 6(xy, x/y). 
An identity for ^-functions that we frequently use is 

y 

9(xv, x/v, yw, y/w) — 9(xw, x/w, yv, y/v) = —9(xy, x/y, vw, v/w), (1.1) 
see [5j Exer. 2.16(i)]. The basic hypergeometric function r cf) s is defined by 

xi,x 2 ,...,x r ^ \ = y, ( Xl ,x 2 ,...,x r ;q) k / ^k k(k-i)/2\ 1+8 ~ r z k 
2/2, - - - , 2/ s ' ' / f^ o (q,yuy 2 ,...,ys;q)k^ J 

2. The second order ^-difference operator 

In this section we introduce an unbounded second order g-difference operator L acting 
on functions on a g-analogue of the real line, and we determine a dense domain on which 
L is self- adjoint. 

2.1. The difference operator. We fix two real numbers z + > and z_ < 0. Let 

and R~ be the two sets 

R+ = { z+q n R- = {z_q n \ n G Z}, 

and define 

R q = R~ U R+ 

which we consider as a g-analogue of the real line. For x G R q we sometimes write x = zq k , 
which means that z = z_ or z = z + , and k G Z. We denote by F(M. q ) the linear space of 
complex- valued functions on R q . 

The second order difference operator L we are going to study depends on four param- 
eters. Let P q>z _ )Z+ be the set consisting of pairs of parameters (a, 0) G C 2 such that 
a, ^ z^q^, and one of the following conditions is satisfied: 

• a = (3 

• there exists a ko G Z such that z + q k ° < < a -1 < z+q kii ~ x 

• there exists a ko G Z such that z_g fco_1 < a -1 < < z^q k ° 

In particular this implies that q < \ot/(3\ < 1, and a and (3 have the same sign in case 
they are real. We define the parameter domain P to be the following set, 

P = {{a,b,c,d) G C 4 | (a, b) G P q , z _, z+ , (c,d) G P q , z _, z+ , a ^ b}. 

From here on we assume that (a, b, c, d) G P, unless explicitly stated otherwise. 
We define a linear operator L = L a> b jC) d : F(lR g ) — > F(R q ) by 

L = A(.)T,-i + B(.)T, + C(-)id, 

where T a is the shift operator (T a f)(x) = f(ax) for a G C, id denotes the identity 
operator, and 

^--'t 1 -£)(-£ 

Z?(.r) = .s| 1-— ^ (l--^) 

cx J \ dx I 



C(x) = s' 1 + s - - S(ar), 
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where s = \J cdqjab. Here we use the usual branch of yf- that is positive on R + . Note 
that the conditions on the parameters ensure that A(x) ^ and B(x) ^ for all x G R g . 

Remark 2.1. (a) There is an obvious symmetry in the parameters; 

La,b,c,d P&,a,c,<i L a ^^ c . 

This will be useful when we study eigenf unctions of L later on. 

(b) Let a = z+ q x ~ m , m G Z fixed, (so (a,b,c,d) G" P), then the coefficient A(x) 
vanishes at the point x = z + q m . In this case certain restrictions of the difference operator 
L are well known in the literature. Let L_ (respectively L + ) denote the operator L 
restricted to functions on {z + q k \ k G Z> m } (respectively {z + q k \ k G Z< m _i}). Then L± 
is equivalent to the Jacobi operator for the continuous dual g ±1 -Hahn polynomials, which 
are Askey- Wilson polynomials with one of the parameters equal to zero, see [2], 
Moreover, the operator L restricted to functions on R~ U {z + q k \ k G Z> m } is equivalent 



to the difference operator studied by Koelink and Stokman [13] to obtain the big q- Jacobi 
function transform. 

If we also set c = zZ 1 q~ n , n£Z fixed, then the coefficient B(x) vanishes at the point 
x = z^q n . In this case the operator L restricted to functions on {z_q k | k G Z> n } U 
{z + q k | k G Z> m } is equivalent to the difference operator for big q- Jacobi polynomials, 
see [TBI Sect. 10] where the orthogonality relations for the big q- Jacobi polynomials are 
obtained from spectral analysis of L. See also [1] and [UJ for the big q- Jacobi polynomials. 

2.2. The Casorati determinant. The Jackson g-integral is defined by 

/ f(x)d q x = (1 -q)^f{aq k )aq k ) 

P rP ret 

f{x)d q x = / f{x)d q x - / f{x)d q x 

a JO JO 

-c!o(a) °° 

- k )aq k 



/ f(x)d g x = (l-q) V f(aq k 

Jo 



k= 

for a, P G C*, and / is a function such that the sums converge absolutely. We will denote 

f{x)d q x = / f{x)d q x - / f{x)d q x, 



JO Jo 
We define a weight function w on M g by 

w(x) — w(x: a, b, c, d; q) — -. — ' , - ^\°° . (2.1) 

(ex, dx] gjoo 

Note that for (a, b, c,d) G P the weight function w is positive on M. q , and w is continuous 
at the origin. Let C 2 = C 2 (R q ,w(x)d g x) be the Hilbert space consisting of functions 
/ G F{R q ) that have finite norm with respect to the inner product 



(f,9)c*= f(x)g(x)w(x)d q x. 

JM. q 

For fc,!,m,n6Z we define a truncated inner product by 



{f,g)k,i-,m,n= \ f (x) g(x)w (x)d q x + / f (x)g(x)w(x)d q x 
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If /, g e C? we have 

lim {f,g)k,l;m,n= (f,g)&- 
k,n— >— co 

We define a function -u on R 9 , closely related to the weight function w, by 

u(x) = (1 - g) 2 S(a;)a; 2 «;(a;) = (1 - g) 2 v / g7^ 7 ^ 1 ^ L ^ 

(cqx, dqx; q) 



oo 



Definition 2.2. For f,g£ F(R q ) we define the Casorati determinant D(f,g) G F(R ? ) 
by 

D (f,g)(x) = (f(x)g(qx) - f{qx)g{x)^ 



(1 - q)x 

= [(DJ)(x)g(x) - f(x)(D q g)(x))u(x). 
Here D q : F(M. q ) — > F(R ? ) is the g-difference operator given by 

m f)(x) = li^LJM. 

Proposition 2.3. For /, g e F(R ? ) we /iawe 

(Lf, g)k,l;m,n ~ (/, Lg)k,l- >m ,n = 

D(f,g)(z-<1 1 ) - D{f,g){z_q k - 1 ) + F>(/, s)^"- 1 ) - D(f,g)(z + q m ). 

Froo/. For 

((Ff)(x)g(x) - f(x)(Lg)(xj)xw(x) = 
A{x)(j(x/q)g(x) - f(x)g(x/q) s jxw(x) 

+ (j{xq)g{x) - f{x)g(xq) s jxw{x) 

(ax/q.bx/q-.q)^ q 2 
(cx, dx; q)oo xsab 
ax, bx; q)^ s 



f(x/q)g(x) - f(x)g(x/q) 
+ (f(xq)g(x) - f{x)g{xq)^j 



{cqx, dqx; q)^ cdx 
Note that abs/q = yj abed/ q = cd/s, so we obtain 

((Lf)(x)g(x) - f(x)(Lg)(x)yi - q)xw(x) = D(f,g)(x/q) - D(f,g)(x). 

Now the sums of the truncated inner products in the lemma become telescoping, and then 
the result follows. □ 

In order to determine a suitable domain on which L is self-adjoint, we need to find 
the limit behavior of Casorati determinants. First, to find the asymptotic behavior of 
D(f,g)(x) for large x, we need the behavior of u(x) for large x. 
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Lemma 2.4. Let x = zq~ k G R g; then for k — »■ oo 

(l-g)- 1 ^ S - 2fc (l + C»(g fc )) : 

(l-g^-^l + Ofa*)), 



;r 

K z = K z {a, b, c, d; q) = z(l - q)— — . 

V[cz, dz) 

Proof. Let x = zq~ k G R g . Using the identity 

(aq- n ;q) n (q/a;q) n ( a\ n 



(J3q-»;q) n (q/ '(3; q) n \(3 , 
and the definition (12.11) of the weight function to we obtain 

_ fc (q/az,q/bz;q) k (az,bz;q) 00 ( ab\ k 
w{zq J 



(q/cz,q/dz;q) k (cz,dz;q) OQ \cd J 

and 

/ -fc% / n x2 rm (q/az,q/bz;q) k (az,bz;q) oc 

u{zq ) = {l-q) ^q/abcd— — — — ., 

{1/cz, 1/dz; q)k{zcq, zdq; q)^ \cdq\ 

From this the asymptotic behavior of xw(x) and u(x)/x for large x follows. □ 
Lemma 2.5. Let f,g G £ 2 , i/jen 

lim D(/,^)(x)=0. 

Proof. Let f,g£ C 2 . Using the asymptotic behavior of ot(i) for large x, see Lemma \2. 41 
we find that / and g satisfy 

lim s~ k f(zq~ k ) = lim s~ k g(zq~ k ) = 0. 

k^oo k^oo 

From Definition 12.21 and the asymptotic behavior of u(x)/x from Lemma [2.41 we now see 
that liin^-D (f,g) (zq~ k ) = 0. □ 

2.3. Self-adjointness. For / G F(R g ) we denote 

/(0~) = lim f(z_q k ), /(0+) = lim f\z + q k ), 

k— >oo K— >oo 

/'(0-) = lim (D q f)(z.q k ), /' (0+) = lim (£>„/)(*+?*), 

fe— >oo A;— +00 

provided that all these limits exist. 

Definition 2.6. We define the subspace T> C C 2 by 

V = {feC 2 I Lf G £ 2 , /(0-) = /(o+), /'(0-) = /'(0+)} . 

The domain T> contains the finitely supported functions in C 2 , hence T> is dense in C 2 . 

Proposition 2.7. The operator (L,T>) is self-adjoint. 

The proposition is proved in the same way as [T3], Prop. 2. 7]. For convenience we repeat 
the proof here. 
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Proof. First we need to show that (L, T>) is symmetric. Let /, g G T>. Using the second 
expression in Definition 12.21 we find 



D(f,g)(Q~) = «(0) (D q f)(0-)g(0-) - f(Q-)(D q g)(0' 



= u(0)((D q f)(0 + )g(0+)-f(0 + )(D q g)(0^ 

= D(f 1 g)(0 + ), 
By Proposition 12.31 and Lemma [2.51 this leads to 

(Lf, g)jC? - (f, Lg) C 2 = lim ((Lf, g)k,l;m,n ~ (f, Lg)k,l;m,n) 

l,m— >oo V / 

= D(f,g)(0 + )-D(f,g)(0-) = 0, 

hence (L,T>) is symmetric with respect to (•, -)c2. 

Now we know that (L,T>) C (L*,T>*), where (L*,T>*) is the adjoint of the operator 
(L,T>). Observe that 

L — L\ . 

Indeed, let / be a nonzero function with support at only one point x G M. q and let 
g e F(Rg), then 

(Lf,g)c* = {f,Lg) C 2- 

In particular, for g E T>* we then have {f,Lg)c2 = (f,L*g) C 2, so (Lg)(x) = (L*g)(x). 
This holds for all igR,, hence L* = L\-p*. 

Finally we show that T>* C T>. Let / G T> and let g G T>*. Using Proposition 12.31 and 
Lemma 12. 5\ 

D(f,g)(0-) - D(f,g)(0+) = (Lf,g) c2 - (f,L*g)& = 0. 

Since this holds for all / G V, we find that the limits g(0~), g(0 + ), <7'(0~) and g'{0 + ) 
exist, and 

^(o-) = ^(o + ), ^(o-)=^(o+), 

hence jeD, which proves the proposition. □ 
Remark 2.8. Let / G T> and let a be a complex number with \a\ = 1. We define 



f{x), x G R", 
af(x), XGM+, 



then it is easy to verify that /(0 ) = a/(0 + ) and f'(0 ) = a/'(0 + ). So we have a family 
of dense domains 

V a = {/ G £ 2 | L/ G £ 2 , /(0-) = a/(0+), /'(0") = a/'(0+)} , 

such that (L,V a ) is self-adjoint. Without loss of generality we may work with the dense 
domain T> = T>\. 



3. ElGENFUNCTIONS 

In this section we study eigenfunctions of the second order difference operator L. 
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► C | L/ = /x/}, 

► C | L/ = /x/}, 

C | L/ = /(0-) = /(0 + ), /'(0-) = /'(0+)} 



3.1. Spaces of eigenfunctions. For /jgCwe introduce the spaces 

= {/ 
^ + = {/ 

v, = {f 

Lemma 3.1. Let \x G C. 

(a) For f,g G V^* 1 i/ie Casorati determinant D(f,g) is constant on 

(b) For f,g &Vfj, the Casorati determinant D(f,g) is constant on I 

(c) dimVj = 2. 

(d) dimV^ < 2. 

Proof. For (a) let /, g G F(R 9 ). From the proof of Proposition 12.31 we have 

(Lf)(x)g(x) - f(x)(Lg)(x))(l - q)xw(x) = D(f,g)(x/q) - D(f,g)(x). 

Now if / and g satisfy (Lf)(x) = nf(x) and (Lg)(x) = ^g(x), we find D(f,g)(x/q) = 
D(f,g)(x), hence D(f,g) is constant on R+ and R~. 

Let f,g G V^. Statement (b) follows from (a) and the fact that D(f, g)(0~) = 

W- .'/)«>)• 

For (c) we write f(zq k ) = fj~, then we see that L/ = fif gives a recurrence relation of 
the form ackfk+i + fikfk + Jkfk-i = A* /fcj with 7^ 7^ for all G Z. Solutions of such a 
recurrence relation are uniquely determined by specifying at two different points k = I 
and k = m. So there are two independent solutions, which means that dimV^ = 2. 

Finally, suppose that fi, f 2 G are such that the restrictions f[ es = are linearly 
independent in V^~. By (a) the Casorati determinant D(fJ es , f 2 es )(x) is nonzero and 
constant on Rjj~, hence D(f\, f 2 ) is nonzero and constant on R 9 . Therefore fx and /2 
are linearly independent. Now choose a function / 3 G V^. Since dimV^ + = 2, we have 
f^ es = af[ es + Z?/™ 5 f° r some constants a,/3 G C. This shows that 

D{h, f x ) = D{fi e % m = mfri m = mh, /o, 
D(f 3 , f 2 ) = D(r 3 e % m = aD(fr, fn = «^(a, / 2 ), 

hence fs = af\ + (3f 2 . So dim < 2. □ 

3.2. Big g-Jacobi functions. Let P gen be the dense subset of P given by 

-Pgen = {(a, b, c, d) G P I c 7^ d, c/a, c/6, d/a, cd/ab G" g z }. 

From here on we assume that (a, 6, c, c?) G P gen , unless stated otherwise. 

The difference operator L is equivalent to the difference operator studied in [T3]. To 
see this set 

X = -™, A = s, B=V, C= q A (3.1) 
q sa sa 

where the capitals stand for the parameters in [T3] . We have the following eigenfunction, 

which is called a big g-Jacobi function, 

cp 7 (x) = V3 7 (x; a, b, c, d\q) = 3 <p 2 y^^^/j ! <?, ^ » M < • ( 3 - 2 ) 

If \x\ < \q/b\, the function yj 7 is a solution of the eigenvalue equation 

(Lf)(x) = /i( 7 )/(x), /i( 7 ) = 7 + 7" 1 , (3.3) 
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where 7 G C* and x G K g . This can be obtained from [13J, or directly from the con- 
tiguous relation [8, (2.10)]. For a function / depending on the parameters a,b,c,d, 
/ = /(•; a, b, c, d), we write 

/t = /t(. ; a> 6 ? C) rf) = /(•; b, a, c, d). 

Clearly, we have (P)^ = /. Since L a ^ Cjd = L h ^ c>d , cf. Remark 12.1( a). it is immediately 
clear that <^ 7 is also a solution for the eigenvalue equation (\3.3L If a = b, we have <pl(x) = 

<p*y{x). The symmetry L aj & iC) d = £ a ,6,d,c does not give rise to different eigenf unctions. 

So far the functions y> 7 (:c) and (p\(x) are defined for small x G M 9 . Using the eigenvalue 
equation (13. 3p the functions y 7 and y> 7 can uniquely be extended to functions on whole 
Mg (that we also denote by v? 7 and ipt) that also satisfy (13.31) . Later on we give explicit 
expressions for the functions ip>y(x) and <ft(x) for \x\ > q/\b\. 

First we establish the g-differentiability at the origin of the functions tp 1 and ip^. 

Proposition 3.2. The functions ip-y and are continuous differentiable at the origin. 
At x = we have 



V9 7 (0;a,6,c,ci|g) 



2^2 



jy^cdq/ab, ^cdq/ab/'y bq 
cq/a, dq/a 

6(l-s 7 )(l-s/ 7 ) 



^(0;a I 6 lC ,d|?) = (1 _ ^ - ^ - dq/a f ^ W\ bq~\ cq*, dq*\q). 

Proof. The expression for <£> 7 (0) follows from letting x — > in (13.21) . If \x\ is small enough, 
we find from the explicit expression (13.21) for (p 7 , 

^(x) - ^(qx) = g {qjCq ^ dq/a ; q)n (bxr [(q/ax; q) n - (1/ax; q) n q< 

= E ^ S /r,q)n {hx) n {q/ax . )b _ i(1 _ g n } 
^ {q,cq/a,dq/a;q) n 

bx(l — s 7 )(l — s/ 7 ) f q/ax, sqj, sq/^f 



(1 — cq/a)(l — dq/a) 3 2 \ cq 2 /a,dq 2 /a 
Now it follows that the g-derivative of <£> 7 is given by 

= (1 - g )(l - cg/a)(l - dq/af ^ Xq2 ' aq 2M 2 ^ 2 ^ 2 ^- 
Letting x — > gives the result. □ 

3.3. Asymptotic solutions. We define the set of regular spectral values 

<S reg = C* \ {±q^ k \keZ}. 

For 7 G 5 reg U {±1} another solution for the eigenvalue equation (13. 3p is the function 

$ 7 (x) = $ 7 (x; a, 6, c, o?|g) 

= / Nfc (q/bx, g 2 i/ asx; q)^ ( q>y/s,cq>y/sa,dq>y/sa ^ q\ ^ q_ (3.4) 

(q/cx, q/dx; q)oo \ q 2/ y /asx, q^ 2 ' ' bx ) ' |6|' 



g, for 
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where x = zq~ k , see |13j . For x — > ±00 we have 

%{zq- k ) = {s 1 ) k {l + 0{q k )) 1 k^oo. (3.5) 

Clearly $ 7 -i, $ 7 and $ _i are also solutions to (13.31) . We remark that it follows from 
applying the transformation [5j (III. 9)] for 302-series, that 

(q/cx, q/dx; q)oo \ q 2/ y /bsx, qy 1 ' ' ax J ' 

So we see that $ 7 = $ 7 , and if 7 G K we see that $ 7 is real- valued. Using the eigenvalue 
equation L$ 7 = /x(7)$ 7 we can extend $ 7 to single- valued functions $ 7 on R+, respec- 
tively $~ on K~. We call $+ and $~ the asymptotic solutions of Lf = fi(j)f on R+, 
respectively M~. The following lemma shows that $ 7 and $ _j are linear independent, 
hence they form linear bases for the eigenspaces 

Lemma 3.3. For 7 G 5 reg we have 

D(^,^ h )(z ± q~ k ) = ( 1 -1/ 1 )K Z± . 

Proof. Since lies in V^t the Casorati determinant $^ 7 ) is constant on R+, so 

we can find the Casorati determinant by taking the limit x — > 00. From Lemma [2.41 we 
find 

fc^oo z+g fe (l — g) 

and then it follows from the first expression in Definition 12.21 and ( 13.5ft that 

lim D($+ $+ /7 )( 2+ g- fc ) = (7- lh)K z+ . 

The proof for $~ is similar. □ 

Now we can expand the functions <£> 7 and y? 7 on Vj, -j in terms of $ 7 ±i- The expansion 
of in terms of $1" ±1 (respectively $~±i) gives an explicit expression for </? 7 for x > 
(respectively x < —q/\b\). For 7 G iS reg we define a function 0^(7) by 

(s/i,cq/as7,dq/asr,q)oo0(bszy) 

{cq/a, dq/a, I/7 2 ; qjooO^bz) 

The desired expansion uses the c-function, see [THl Prop. 4. 4] with parameters as in (13.11) 
and Z = za/q, or use the three-term transformation for 3 2 -functions [5, (III. 33)]. 

Proposition 3.4. For 7 G iS rcg and x = z±q k G R g; 

y? 7 (x) = c 2± ( 7 )$±(x) + c z± ( 7 - 1 )$^ 1 (x), 

^Ux)=cl( 1 )^(x) + cl( 1 - l )^. 1 (x). 



The spaces V? and V% are 2-dimensional by Lemma 13.11 but they are clearly not 
spanned by <3> 7 and *&xHi s i nce 7 = ^1 here. In the following lemma we give linear bases 
for the spaces and V\ that will be useful later on. 



Lemma 3.5. For 7 = 1 or 7 = — 1, the functions and 



for the spaces , respectively V%. 



form a linear basis 

7' =7 
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Proof. Differentiating the equation L$+ = ^(7)$+ to 7, and setting 7 = ±1 shows that 

^ L | 7=±1 is an eigenfunction of L for eigenvalue ±2. From the asymptotic behavior (13.51) 
of $^ we find 



c?7 



(zq~ 



00, 



and then using Lemma 12.41 it follows that 



c?7 



7 2fe " 2 K 



x G 



7=±1 



7^ 0. This proves the lemma for $+. 



7 
□ 



For 7 = ±1 we see that -D($±i, 

For $~ the proof is the same. 

3.4. A basis for V^. We are going to show that, under certain conditions on 7, the 
solutions ip-y and <£> 7 form a linear basis for V^( 7 ). We do this by computing the Casorati 
determinant D((p^,ip^). 

Lemma 3.6. For igK, and 7 G C* we have 

(l-q)q (s^,s/r,q)oo0(a/b) 



as icq/ 'a,cq/b,dq/ ' a^dq/b^q)^ 

Proof. Let 7 G 5 reg . From Proposition 13.21 we know that y? 7 ,y? 7 G V^( 7 ), hence by 
Lemma 13.11 the Casorati determinant D((p 1 , (pi) is constant on M. q . In order to calcu- 
late D(<f 7 , <fl)(x) we use the c-function expansions from Proposition 13.41 

Dfa,<p\)(x) = Yl c 2+ (7 £ )4 + (7^) J D($+,$+)(a;), x = z + q- k . 

e,7?e{-l,l} 

We apply Lemma 13731 then 

D(^,cp\)(z + q- k ) = (7- l/ 7 )^ + (c z+ (7)4 + (l/7) -c z+ (l/7)4 + ( 7 )). 
Using cq/as = bs/d and dq/as = bs/c, we find 

c, + ( 7 )4 + (l/7)-c z+ (l/7)4 + (7) = 

(s7,s/7;g)oo 

(7 2 , 1/7 2 ; q) QO (cq/a, cq/b, dq/a, dq/b; q) 00 6(az + , bz + ) 

x (^(q/bsz+j, q r y/asz + , cq^/bs, cq/asj) — 9(q r y/bsz + , q/asz+j, cq/bsj, cqj/as] 
Now we use the ^-product identity (11.11) with 



x 



y 



qe~< 



bs 



qe~< 



c\ 



as 




v = "fe- 



rn = 7e 



\c\z+, 



\C\Z: 



where c = |c|e JK , then we obtain 
c, + (7)4 + (l/7)-c, + (l/ 7 )4 + (7) 



>7, s/7; q) oc 9(a/b, cz + , dz + ) 



asz + ("f — I/7) (cq/a, cq/b, dq/a, dq/b; q) OQ 9(az + , bz + ) 
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With the explicit expression for K z+ we find the desired result for 7 G iS reg . By continuity 
in 7 the result holds for all 7 G C*. □ 

Let <S P oi be the set of zeros of 7 1— > D(ipj, ipty, i.e., 

5 P oi = {sq k I k G Z> } U {s~ l q- k \ k G Z> } . 

Proposition 3.7. Let 7 G C* \ <S po i, then dimV^( 7 ) = 2 and the set {(p^,^} is a linear 
basis of V^( 7 ) . 

Proof. From Lemma 13.61 it follows that y? 7 and <£> 7 are linearly independent if 7 G" «S po i- 
Since both functions are continuously differentiable at the origin, see Proposition 13.21 and 
since dim V^( 7 ) < 2 by Lemma 13.11 we have dim V^( 7 ) = 2, and y? 7 and <£> 7 form a linear 
basis for V^( 7 ). □ 

Corollary 3.8. For 7 G C*\5 po i every function in V^t \ (respectively has a unique 

extension to V^( 7 ). 

Proof. Fix a 7 G C* \ <S po i and denote /x = ^(7). We consider the restriction map 
res : — > defined by f res = /| R +. Let / and g be linearly independent in V^. As 
in the proof of Lemma 13.11 it follows that f res and g res are linearly independent in . 
Since dim = dim = 2 the map res is a linear isomorphism. In a similar way a linear 
isomorphism between and V~ can be constructed. □ 

For 7 G <S po i the big g-Jacobi functions tp 1 and y? 7 are actually multiples of big g-Jacobi 
polynomials, see [US, Prop. 5. 3]. The big g-Jacobi polynomials, see pQ, [TT], are defined by 

(q~ k , ct/3q k ~^~^, x \ 
' ' ;q,q , fc G Z> . 

ag,<5g J 

Lemma 3.9. Let 7^ = sq k G <S po i or 7^ = s -1 g~* G «S po i, 

(cq/b,dq/b;q) k ( b\ k f 

and 

^ W = 8 -i^"(-=)*^iW-;<=/M/.,^ 8 ), 

/or x G M g . 

Proof. Let A; G Z>o and 7^ = sg fc . From Lemma I3T61 we see that the Casorati determinant 
D((p lk , ip*)(x), x G Mq, is equal to zero, hence (p-, k (x) = Ck<pl (x), for some constant C k 
independent of x. To find the constant Ck we use Proposition 13.41 We have c z {^/k) = 
and <4(7fc) = 0, hence 

cp, k (x) = c z+ (l/ lk )<S>+ (x) = C ; +i ^ k K \ k (x), x = z + q n G R q . 

ci + (l/7fc) 

Using 9(q k x) = (—x)~ k q~^ k ( k ~^ 9 (x) we find 



C, 



c z+ (l/jk) (cq/b,dq/b;q) k (b 



-2+ 



'Mlk) (cq/a,dq/a;q) k \a 



k 



Since y? 7 = <^i/ 7 the result also holds for 7^ = 5 q , k G Z 



>o- 
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Finally, writing out ¥>\ k (x) explicitly as a 3 2 -series using ( 13. 2 p and then applying the 
transformation formula [5, (III. 13)] shows that ip\ /k (x) is a multiple of a big g-Jacobi 
polynomial in the variable ex. □ 

3.5. Extensions of the asymptotic solutions. By Corollary 13.81 the asymptotic so- 
lutions $ 7 G V^,) and $ 7 G V~,-, have unique extensions to V^( 7 ), provided that 
7 G C* \ <S P oi- We denote these extensions again by and $~. Propositions 13.71 and 13.41 
enable us to expand $ ±1 in terms of the basis {y? 7 , y? 7 } of V^y 

Proposition 3.10. For and 7 G S ieg \ {sq k | k G Z> } 

= d z+ ( 7 )p 7 (x) + 4 + (7)<p\(x), 

$-(x) = 4,(7)^7^) + 4_ (7)^^)' 

w/iere 

(cq/a,dq/a;q)oo9(bz) (cq-y/sb,dqy/sb;q) 00 Q(asz/qy) 
4(7) = 4(7; a, f, c, d| 9 ) = , ( „ A „ i(fe) (,7V S /7;<iU ' 

Proof. Let 7 G 5 reg \ <S po i- By Proposition 13.71 we may expand 

&y{x) = d z± {y) Vl {x) + e z± (7)^(2), x G Rg, 

for some coefficients d z (j) and e 2 (7) independent of x. In order to compute the coefficients 
d z (y) and e z (j) we observe that it follows from $^ = ^ that e z (7) = ^(7). To compute 
4(7) we use 



D((p 7 ,tplf)(x) 

From the c-function expansion, Proposition I3.4[ we find 

D($$,<p\)(x) = 4 ± (1/ 7 )L»($± $f /7 )(x) 
and then it follows from Lemmas 13.31 and 13.61 that 
(7-1/7)^4(1/7) 



X G Kg, 



4(7) 



D(<fh,<p\) 

asz(cq/a, dq/a; q)oo9(bz) (7 - l/y)(cqy/bs, dqy/bs; q) oo 0(asz/y) 



q9(a/b,cz,dz) (l 2 ,s/y;q)oo 

Here we also used the explicit expression for K z from Lemma 12.41 This is the desired 
result for 7 G iS reg \ «S po i- By continuity in 7 it holds also for 7 G {s _1 g~* \ k G Z}. □ 

For 7 = s~ 1 q~ k , k G Z> , the Casorati determinant _D(<£> 7 , <£> 7 ) is equal to zero, hence 
<£> 7 is a multiple of y? 7 . In this case Proposition 13.101 states that $ 7 is also a multiple of 



Corollary 3.11. For y k = s~ 1 q~ k , k G Z> 0; 

k 



Lfc(fc-i) f "JA (cg/fe» dq/b;q) k j 
az±) (s 2 ;q) k 



$i fx) = g^v 1 1 — — - (r) 
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Proof. Using Proposition 13.101 and Lemma 13.91 we find 

(cq/b, dq/b; q) k F. 



KM 



aq \qcdz + 



k-l 



(q l ~ k / s 2 ; q) k 9(b/ a, cz + , dz 



with 



F z+ = 9(cq/a, dq/a, q/bz + , cdqz + /b) — 9(cq/b, dq/b, q/az + , cdqz + /a 
Applying the ^-product identity (11.11) with 

— , y 



X 



qe 



qe 



i(k+S) 



-i(K+8) 



b (i 

iS 



w 



where c = \c\e lK and d = \d\e , we obtain 

F z+ = °^ Z+ 9(cdq 2 /ab, a/b, l/dz + , 



Applying (q /y; q) k = (-y) q 



k -ifc(fe-l) 



(y; q)k, identities for ^-functions, and s 2 = cdq/ab, 



the result follows for . Replacing z + by z^ gives the result for $ 



□ 



In the expansion of in Proposition 13. 101 we have assumed that 7 ^ {sg fc | G Z}. 
At first sight it seems that the functions considered as functions of 7 and with 

x G M g fixed, have simple poles at the points 7 = sq k , k G Z> , which are the poles of 
the function d z {^). It turns out that the functions are actually analytic at these 

points. 



Proposition 3.12. For a given x G 
particular, for j k = sq k , k G Z ; 



t/ie functions 7 1— > are analytic on S TCg . In 



J >0> 



d 



7=7fc 



7=7fe 



+ Res(4 ± ( 7 )) 



7=7fe 



7=7fc 



where 



dz^k 



lim 



f (cq/b, dq/lr, q) k (T)*^) +d t( 7 ) 



7^7fc \(cq/a,dq/a;q) k \a 



Proof. The expansion from Proposition 13.101 shows that the functions 7 1— ► $jr(a;), for a 
given a; G Mg, are analytic functions on S reg \ {sq k \ k G Z}. So we only have to consider 



>o- 



the functions at the points 7^ = sg , fceZ 

Fix a G Z>o and a a; G R 9 . The function 7 1— > 4(7) has a simple pole at 7 
coming from the zero of the infinite product (s/7; 0)00, and the functions 7 1— > <£> 7 (x) and 
7 I— > are analytic at 7 = 7^. From Proposition 13.101 and Lemma [3.91 it follows that 



(7 - 7fc)4 + (7)^^ + (7 - 7*)4+(7)— 

- _ ~ , 7 - 7a 



7 - 7fc 



+ 



/ (cg/6, dq/b; q) k / 6 



I (cq/a, dq/a; q) k \a 



4 + (7)+4 + (7) K» 



We see that the limit lim 7 ^ 7fc $ 7 (x) exists if 4 + (7fc), as defined in the proposition, exists. 
Let us define 

4(7) = (s/7; 9)oo4(7)) 
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then 7 i— ► d z (j) is regular at 7 = 7^. By a straightforward computation we obtain 

(g/W6; g )» m'j - , 

(cq/a,dq/a;q) k \aj 

and then it follows that d^k) exists. □ 
We now have the following properties of the functions 

Theorem 3.13. For 7 G 5 reg i/je functions $^ satisfy the following properties: 

(a) $± G^). 

(b) For I7I < 1 we /iai>e 

/ |$ 7 (x)| U){x)dqX < OO, / |$^(x)| U]{x)dqX < OO. 

Joo(z-) JO 

(c) T7ie Casorati determinant 11(7) = zs constant on W q , and 
= v(r,a,b,c,d; z_,z + \q) 

z+(l - q)6(z^/z + ) (cq'y/as, dq'y/as, cq^/bs, dq^/bs, 57, q'y/s; q) oc 6(absz-Z + /q'y) 
6(cz_,dz-,cz +} dz + ) i(qi 2 ; q)lc 

Proof. Properties (a) and (b) follow directly from Proposition 13.101 and the asymptotic 
behavior of $^ (x) for \x\ — > 00, so we only need to check the third property. 

Let 7 G iS reg \ {sq k \ k G Z> }. Since G V^( 7 ) the Casorati determinant F>($~, $+) 
is constant on M q by Lemma [3.11 To calculate the determinant we use Proposition 13. 101 
then 

$;) = d J _( 7 )I>($+ ^ 7 )+4_( T )F>($+ <pt). 
We find from Proposition 13.41 and Lemma 13.31 

£>(<&+ <^ 7 ) = c 2+ (l/7)^($+,$+ 7 ) = (7 - l/ 7 )c 2+ (l/ 7 )^ + , 
F>(<t>+ pt) = c t + (l/ 7 )L>($+ $+ /7 ) = ( 7 _ l/ 7 ) c t + (l/ 7 )^ + , 

so we have 

£>(<&+<&;) = (7- 1/7)^(^(7)^(1/7) + 4.(7)^(1/7))- 

From the explicit expression for d z _ (7) and c z+ (7) we obtain 

t f bsz-(cq-f/as,dq^/as,cq-f/bs,dq^/bs,sr,q)oc 

d z _ 7 c 2+ 1/7 + 4_ 7 4 1/7 = — — — — — — — 

57(7 , 57 , s/75 q)ooO{cz-,dz_, b/a, az + , bz + ) 

9(bz_, az + , asz_/ r j, bsz + /^) — 8(az-, bz + , bsz^/j, asz + / r y) 



Using the ^-product identity (11.11) with 

ise'^+W 2 y/\abz + z_\ 



x 



i(a+f3)/2 r 



7 



v — le 



i(a-/J)/2, 



6^4 



,7 = k " 1 \/\abz^z 

a <09-«)/2 



w = ie 



bz. 



az A 



where a = |a|e m and 6 = |6|e J/3 , the term between square bracket equals 

bz + 9(z_/ z + , a/b, s/7, absz_z + /^). 



16 



WOLTER GROENEVELT 



Using the explicit expression for K z+ we now find the Casorati determinant given in the 
theorem. By continuity in 7, the result holds for all 7 G S reg . □ 

4. The spectral measure 

In this section we calculate explicitly the spectral measure E for the self-adjoint operator 
(L,V) using the formula, see [H Thm.XII.2.10], 

(E(Ai,A 2 )/,^) £ 2 = limlim-^ / ((R(ji + ie)f,g)&- (R(fi-ie)f,g)&)dii, (4.1) 

<5|0 e4.0 lTX% J Xl+5 V / 

for Ai < A 2 and f,g G C 2 . Here R{p) — (L — /1 6 C \ R, denotes the resolvent 

operator. Our first goal is to find a useful description for the resolvent R(fi). 

4.1. The resolvent. Let A 6 C\M, and let 7a be the unique complex number such that 
I 7a I < 1 and A = //(7a)- Note that 7a G" R, so 7a G <S reg . Let V denote the set of zeros of 
u(7), i.e., 

V= ( |J I A; G Z> | U |^2 + gV a& crf/g | jfe G z] 



eg dg eg dq 
as ' as ' bs ' 6s ' 



If v(j) = $ 7 ) 7^ the functions and $ 7 are linearly independent, hence for 

7 G iS> rcg \ V they form a basis for the solution space V^( 7 ) . 

For A G C \ (R U (j,(V)) we define the operator R X :V -> F(R q ) by 



(R x f)(y) = (f,K x (-,y)) c2 , feV,ye 
where K\ : M. q x R g — > C is the Green kernel defined by 



x > y. 



Observe that by Theorem 13 .131 we have K x (x, ■) 6 D as well as -R'aO, 2/) G V for x,y E M q . 
So i?A is well-defined as an operator mapping from T> to F(R g ). From Propositions 13.101 
and 13.121 we know that the functions $ 7 (x), considered as functions in 7, are analytic 
on iS reg . Now we see that, for x,y G R 9 , the Green kernel K^i^ix^y) is a meromorphic 
function in 7, with poles coming from the zeros of v (7). 

Proposition 4.1. For A G C \ (R U /i(V)), i/ie operator R\ is the resolvent of (L, T>). 

Proof. The operator (L,T>) is self-adjoint, hence the spectrum is contained in R. So for 
A G C \ R the resolvent R(\) is a bounded linear operator mapping from C 2 to T>, and 
therefore for a given y G R g the assignment / 1— ► (R(X)f)(y) defines a bounded linear 
functional on C 2 . By the Riesz representation theorem there exists a kernel K' x (-, y) G £ 2 
such that (R(X)f)(y) = (f,K x (-,y)) C 2. So it suffices to show that (L — \)R\f = f for 

fev. 
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Suppose that y > 0, then, 
(L - X)R x f(y) 

f(x)(A(y)K x (x,y/q)+B(y)K x (x,yq) + (C(y) - X)K x (x,y))w(x)d q x 

1 



(x)U(y)<t>+ (y/q) + (yg) + (<?(</) - \)<S>+ X (y))w(x)d q x 

oo(z_) V 7 

oo(z+) 



v(l\) 

+-— - / (ar)(A(y)$- (y/g) + B(y)^(yq) + (C7(y) - A)$~ (y))«;(a:)d 9 x 



y/q 



+ (1 /M M«; fa/g) + (i/s)*+(») + (Cfo) - A)*- (»)*+(») 



1 - ^fo)^ /fa)(4) + ( _ 4 + 



=/(y)- 

Here we used that <3>^ A are solutions of L/ = A/, 11(7) = Z?($+,$~), and Definition 12.21 
of the Casorati determinant. The proof for y < runs along the same lines. □ 

4.2. The continuous spectrum. We are going to investigate the integrand in (14. ip . 
Using the definition of the Green kernel we have 



(R p f,g)£.2 = JJ f(x)g( y y)K fl (x,y)w(x)w( y y)d q xd q y 

R q XR q 

$ 7>) $ 7>) 



v ^ j (f(x)g(y) + f(y)g(x)) (l - -6 x>y )w(x)w(y)d q x d q y. 

(x,y)m q xR q 
x<y 

(4.2) 

The Kronecker-delta function 5 xy is needed here to prevent the terms on the diagonal 
x = y from being counted twice. 

We define two functions v% and v 2 that we need to describe the spectral measure E; 

(cq/ a, dqj a; qf 00 9{bz + , bz-) 



Ml) 



Mi) 



(1 — q)ahz 2 Lz\9{z- j 'z+, z+/z~, a/b, b/a) 

x (7 ±2 ;g)oo 

(s^ 1 , cq^ 1 /as, dq^ 1 /as; g) 00 6'(s7 ±1 , absz-z+j^ 1 ) 

x (z_9(az + , cz + , dz + , bz_, asz^-y ±r ) — z + 9(az^, cz_, dz_, bz + , asz + ^ ±l ) 

(cq/a, dq/a, cq/b, dq/b; q) oa 9( y az + , az_, bz + , bz-, cdz-Z + ) 
abz 2 _z + (l — q)9(z + /z^, a/b, b/a) 

(7 ±2 ;<?)oo 



(s7 ±1 ; q) oa 9(sj ±1 , absz_z + j ±l ) ' 



Note that V\ and v 2 are both invariant under 7 <-> I/7. Let T>^ n C P be the subspace 
consisting of finitely supported functions in C 2 . To a function / e V^ n we associate two 
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functions T c f and T\f on the unit circle T = {2GC||z| = l} defined by 

(Fcf)(l) = / f{x)(p 1 (x)w{x)d q x, 



(*2/)(t) = / f(x)<pl(x)w(x)d q x, 



where 7 G T. 

We are now almost ready to describe the spectral measure _E((Ai,A 2 )) for (Ai,A 2 ) C 
(—2,2). First we give a preliminary result. The proof is an easy, but rather tedious 
computation that we carry out in the appendix. 

Lemma 4.2. For x, y G M. q and 7, 7 _1 G S reg \ V we have 

v(i/i) v(j) 

vi (7)^ 7 (x)v? 7 (?/) +^2(7) {<Py{x)<p\{y) + <p\{x)<pM) + v\(^\{x)^\{y) 



7 ~ 1/7 



Proposition 4.3. Let (a,b,c,d) G -P gen , let < ipi < ip2 < ^ , and let Ai = /i(e^ 2 ) and 
A 2 = /i(e^). Then for f,geV fin , 

- 1 /; (( ^, (::«::; *::») (<^) * 

Proof. Let A G (—2, 2), then A = yu(e 1 ^) for a unique ■?/> G (0, 7r). In this case we have 



lim 7A±i£ = e^ 

Now we obtain 



which is symmetric in x and y by Lemma 14.21 Symmetrizing the double g-integral from 
( 14. 2 p then gives 



\im((R x+ ief,g)c2 - (R\-ief,g)c- 

ej.0 V 

^(7)v9 7 (x)^ 7 (?/) + u 2 (7)(y 7 (a;)^(2/) + ^(a;)y> 7 (y)) + ^(7)^(^)^(2/) 



7 - 1/7 



x f(x)g(y)w(x)w(y)d q xd q y : 

where 7 = e"^. Rewriting this expression in vector notation and using formula (14. ip . we 
obtain the desired result. □ 

The previous proposition implies that (—2, 2) is contained in the spectrum cr(L) of L. 
Since (p 7 , ipl f G" C 2 for 7 G T, (—2, 2) is part of the continuous spectrum. Observe that the 
spectral projection is on a 2-dimensional space of eigenvectors, so (—2, 2) has multiplicity 
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two. Because the spectrum is a closed set, the points —2 and 2 must be elements of the 
spectrum er(L). 

Lemma 4.4. The points —2 and 2 are elements of the continuous spectrum of L. 

Proof. Since the residual spectrum of a self-adjoint operator is empty, 1) = —2 and 
= 2 must either be elements of the point spectrum or the continuous spectrum. We 
show that 2 is not in the point spectrum of L. The proof for —2 is the same. 

Suppose that there exists a function / G C 2 that satisfies Lf = 2f, then the restriction 
yrcs Q f j ^ jg>+ j g an e i emen {; f y+_ From Lemma [3751 it follows that / res = aQf +(3 

< 7=1 

for some coefficients a and f3. But neither of the functions and -^- 2L is integrable 

with respect to on R+ see (I3.5P and Lemma I2.4[ which contradicts the fact that 
feC 2 . □ 

4.3. The point spectrum. Let ji G R \ [—2,2], then 

lim7 M±ie = 7 M . 

From (14. Xp and (14.21) we see that in this case the only contribution to the spectral measure 
E comes from the real poles of the Green kernel K^(x,y), x, y G R g , considered as a 
function of 7. Let T C V denote the set of poles of the Green kernel inside the interval 
(—1,1). We now have the following property for the spectral measure. 

Proposition 4.5. For real numbers fi\ < ^2 satisfying (/!i,/i 2 ) n f/-t(r) U [—2, 2] J = 0, 
we have /i 2 )) = 0. 

The set T of real poles of the Green kernel inside the unit disc is given by 

r = u rj; s u rf g/as u r inf , 



pfin 



1 



1 aq k 



k G Z> , aq k > 1 



T inf = <^z_z + q k ^/abcd/q k G Z, -z_z + q k ^/ abed/ q < 1 

The superscripts 'fin' and 'inf refer to the finite or infinite cardinality of the sets. Recall 
that for a, b, c, d G R we have assumed that g < a/6 < 1 and q < c/d < 1, therefore 

aco 6co ada 6da 1 

— - — -, — - < 1, 1 < — - < — . 

bd ' ad 1 be ac q 

So the factor (cq r y/as,dq'y/as,cq'y/bs,dq'y/bs]q) 00 of the function ^(7) has at most one 
zero inside the interval (—1,1), and this zero only occurs when a, b,c,d G R. This shows 
that the set T^ as has at most one element. We remark that for (a, 6, c, d) G P gen the real 
poles of the Green kernel are simple. 

Next we need to find the spectral measure on the set ^(T). For this the following lemma 
is useful. 

Lemma 4.6. For 7 G T we have 

= 6( 7 )$-(x), x G Rq, 



20 WOLTER GROENEVELT 

where 0(7) = 0(7; a, b, c, d; z_, z + ; q) is given by 



* / z + \ k+1 9(cz-,dz- 



6(7) 



Z-J 9(cz + ,dz + ) 



. k 

Z. 



Z4 



7 = z_z + q k ^Jabcd/q G T inf , 

7 = s -^ q - k e rf n , 



/ z_ \ k 6(az + ,bz + ,cz-,dz-) ^ _ , ( , 

#(az_, bz_, cz + , dz + ) ' ' 9 ' s 



-1— A; ^- pfin 



6(bz + ,cz_) = as fin 



Proof. If 7 G r, then ^(7) = D($ 7 ,$+) = 0, hence = 6(7)$ 7 for some nonzero 
factor 0(7). For 7^ = s~ 1 q~ k G Tf n the value of 0(7^) follows from Corollary 13.111 For 
the other cases it is enough by Proposition 13.101 to show that d z+ {j) = b{j)d z _{^f) and 
— b( , y)(V z _('y). This is verified by a straightforward calculation. Note that for 
7 = as/dq G T%~ as we have d\ + (7) = d\_ (7) = 0. □ 

We are now ready to calculate the spectral measure E of (L, V) for the discrete part of 
the spectrum a(L). We will write _E({/i(7)}) for the spectral measure E((a,b)), if (a, 6) 
is an interval such that (a, 6) fl fi(T) = {/i(7)}. For / G £ 2 we define a function jF p / on T 
by 

Note that Theorem 13.13( b) and Lemma 14.61 imply that $ 7 G C 2 for 7 G T, so the inner 
product above exists for all / G C 2 . 

Proposition 4.7. Let (a,b,c,d) G P ge n- f,9 £ £ 2 «^d 7 £ T, £/ie spectral measure 
E({fi(j)}) is given by 



(E({^)})f,g) c * = (^/)(7)(^)(7)iV(7), 



iV( 7 ) = iV( 7 ; a, 6, c, d; z_, z+|g) = 6( 7 )- 1 Res 



1/A-A 



A= 7 \ Au(A) 
and 6(7) is given m Lemma \4-6\ 

Proof. Let 7 G T, and /, g G £ 2 . We use (14.1 1) and (14.21) to calculate the spectral measure 
E({fi(j)}). By the residue theorem we find 



(E({fjL(j)})f,g) C 2=— I (Rpf,g)&dn 



Res (1 - 1/A 2 ) 



2^A (X)n(y) 



A=7 V U W 

(a;,y)GlRqXR ? 
x<y 

1 



x (f(x)g(v) + f(y)gjx)) (I - -^ Xiy )w{x)w{y)d q x d q y 

Here C is a clockwise oriented contour encircling ^(7) once, and C does not encircle any 
other points in T. The factor 1 — 1/A 2 comes from changing the integration variable 
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/i = //(A) to A. By Lemma [4.61 we have = 6(7)$", so we may symmetrize the double 
g-integral, and then 

This proves the proposition. □ 

It is an easy exercise to calculate the weight N(j), 7 G T, explicitly The result is as 
follows. For 7 = as/dq G r|jV s we have 

N , v 6>(fe_, cz + , cz + , dz_, dz + )(ac/bdq; q)^ 

z + (l — q)9(bz + ,bdz_z + , z_/ z + )(q, a/b, a/d, c/b, c/d; q)^ 

for 7 = s" 1 ^ G Tf n 

9(cz-, C2 + , gLz_, dz + )(ab/cdq; q)^ 



N(j) 



z + (l — q)9(z_/z + , cdz_z + )(q, a/c, a/d, b/c, b/d; q) 



(q 2 cd/ab,qcd/ab;q) 2 k ( abz\\ k 3 fc(fc _ 1) 



(q, cq/a, cq/b, dq/a, dq/b, qcd/ab; q) k \ q 



for 7 = sq- l - k G T fin 



N(j) 



q/s 

9(az-, bz-, cz + , cz + , dz + , dz+)(cd/abq; q)oo 
z + (l — q)9(az + , bz + , z_/z + , abz_z + )(q, c/a, c/b, d/a, d/b; q) Q 

x (gab/cd,ab/cd; g) 2 k / f+^V g f fc(fc-i) 

(q,aq/c,aq/d,bq/d,bq/d,abq/cd;q)k \ cd ) 



and finally for 7 = absz_z + q k 1 G P nf we have 

9{cz + ,dz + ) 2 {abcdz 2 _z 2 ,/q,abcdz 2 _z\-,q) O0 

Nyj) = — — 

z+(l — q)9(z-/z+)(q, q, abz-Z + , acz-Z + , adz-Z + , bcz_z + , bdz-Z + , cdz-Z + ; q)^ 

{abz-Z + ,acz_z + ,adz_z + ,bcz_z + ,bdz_z + ,cdz_z + ;q) k / z_\ k+1 k ^(k+i) 
{abcdz 2 _z\/ 1 q,abcdz 2 _z\;q)2k \ z + J 

As a result of Proposition 14.71 we obtain orthogonality relations for 7 G T. 
Corollary 4.8. Let 7, 7' G T, then 

= fe- 

Proof. Eigenfunctions corresponding to different eigenvalues of a self-adjoint operator are 
pairwise orthogonal. Since for 7,7' G T, 7 7^ 7', the functions and $i are eigenfunc- 
tions of (L,V) with distinct eigenvalues ^(7) and ^(7'), orthogonality follows. 
Let 7 G T. By Proposition 14.71 

= <£(M7)})$+ = iV( 7 )($+ $+>^, 

from which the squared norm of follows. □ 

Remark 4.9. For 7, 7' G r!? n Corollary 14. 81 gives orthogonality relations for a finite number 
of big q- Jacobi polynomials, see Proposition 13.121 and Lemma 13.91 

Since < 3?^~_i(x) = 1, Corollary 14.81 gives an evaluation of the integral (1, 1)^2 in case T^ n 
is not empty, i.e., if s > 1. 
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Corollary 4.10. For ^Jab/cdq < 1 we have 
(ax, bx; q) c 



~dqX 

Q JR q ( cx 7 dx\ g)oo 

(az + , bz + ; q)^ ( cz + ,dz + \ (az_, bz_; g)^ (cz_,dz_ 
; ^—2V2\ , \q 1 q)-z-- / : ^2^2 , ;q,q 



(cz + ,dzj r ;q) 00 \az + ,bz + ' ' J (cz_, dz_; g)^ \az_,bz_ 
(q, a/c, a/d, b/c, b/d; q) OQ 9(z_/z + , cdz_z + ) 
+ (ab/cdq;q) 00 6(cz_,dz_,cz + ,dz + ;q) 00 ' 

Here 2^2 denotes the usual bilateral series as defined in [5]. 

Remark 4.11. This is the summation formula from p2, Exer.5.10], and it is actually valid 
without the restrictions on a, b, c, d as long as the denominator of the integrand is nonzero 
for all x G M g . Note that there is a misprint in [5, Exer.5.10]: the factors (e/ab, q 2 f/e; g)^ 
on the left hand side must be replaced by (c/qf, q 2 f/c; q)^. 

Corollary 4.12. Let (a,b,c,d) G P gen . The spectrum of the self-adjoint operator (L,T>) 
consists of the continuous spectrum cr c (L) = [—2,2], with multiplicity two, and the point 
spectrum a p (L) = fi(T), with multiplicity one. 

Proof. This follows from Propositions 14.31 14.51 14.71 and Lemma 14.41 □ 



5. The vector- valued big g-JAcoBi function transform 

In this section we define the vector- valued big g-Jacobi function transform T , which is 
closely related to the maps T c , T\ and T p . We show that T is an isometric isomorphism 
mapping from C? into a certain Hilbert space 7i, and we also determine T~ x . The vector- 
valued big g-Jacobi function transform diagonalizes the second order difference operator L; 
let M be the multiplication operator defined by (Mf)(y) = ^(7)7(7) for all ^(7) G o~(L), 
then 

(^oLoF 1 )/ = M/, 

for all / G H such that Mf E H. 

We still assume that (a, b, c, d) G P ge n, and we distinguish between the cases a 7^ b and 

a — b. For a vector y — (j^j G C 2 we denote 

t _ nWm), if a = b, 
{{V2V1), ifa^b. 

With this convention we have for 7 £ RUT and i6l g 




since <p y (x) = <p\(x) if a = b, and ip-y(x) = <^ 7 (x) if a ^ b. 

5.1. The vector-valued big g-Jacobi function transform T . Let F(T U T) be the 

linear space consisting of functions that are complex-valued on T and C 2 -valued on T. 
With the maps T c , T\ and T v we define an integral transform T : V &11 — > F(T U T). 
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Definition 5.1. For f G T>& n we define the vector-valued big q-Jacobi function T by 

^/)( T ), 7er. 

We define a kernel 7), x G R g , 7 G T U T, by 



y> 7 (x) 
ip\(x) 



7 GT, 

(5.1) 



*(x, 7 ) = 

We may write T as an integral transform with kernel 

{rf){-Y)= f f(x)*{x,>y)w(x)d q x, feV &n , 7 G T U T. 

We are going to show that T extends to a continuous operator mapping from C 2 into a 
Hilbert space Ft, that we now define. 

We define a matrix-valued function v on T by 

^2(7) ^1(7) S 



7 >-> v(7) 



^1(7) ^2(7) 



We remark that v(7), 7 G T, is positive-definite. Let 7^. be the Hilbert space consisting 
of C 2 -valued functions on T, that have finite norm with respect to the inner product 

1 f I \T / \ 1 \^7 



(01, #2}w c = -j— : / 02(7) v(7)^i(7) 

4™ J t 7 

where the unit circle T is oriented in the counter-clockwise direction. Let r denote the 
reflection operator defined by (rg)(j) = gi^^ 1 ). We define the Hilbert space Ft c to be 
the subspace of Ft' c consisting of functions g that satisfy rg = g in Fi! c . We denote the 
inner product on Ft c by (-, •)■%,. Furthermore, let Ft p be the Hilbert space consisting of 
complex- valued functions on T, that have finite norm with respect to the inner product 

(gi,92)n P = ^01(7)02(7)^(7). 
We define the Hilbert space Ft C F(T U T) by Ft = Ft c © Hp. 

Proposition 5.2. The map T extends uniquely to an operator T : C? ^FL, satisfying 

Hence, T is an isometric isomorphism onto its range 1Z(J-) C Ft. 
Proof. Let fx, fz G T> &11 . Combining Propositions 14.31 and 14.71 we find 

(/i,/2>*» = (E(R)fx,f 2 )cz = {Th^h)n- 

Here we used 



mm) = . 
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Since V^ n is dense in £ 2 , the map T extends uniquely to a continuous operator, also 
denoted by JF, mapping isometrically into TZ(J-") CH. □ 

Lemma 5.3. Let y el, and let f y (x) = S xy /w(y) G C 2 , then T f y = *&(y, •) G Tt. 

Proof. We have 



{Ffy){l) 



so jF/y = •). By Proposition 15.21 this lies in TC. □ 
We define an integral transform Q : 7i — > by 

= <</,*(&,•))«, 9^, xGR ? . 

By Lemma [5731 this inner product exists for all g We denote by £? c , respectively C/ p , 
the integral transform Q restricted to TC C , respectively 7i p . 

Proposition 5.4. QT = id C 2 

Proof. Let / G C 2 and let f y G C 2 be defined as in Lemma 15.31 then it follows from 
Proposition 15.21 that 

f(y) = (/,/»)/? = {Tf.TQn = (G(Ff))(y). □ 

We showed that Q is a left inverse of T. Next we are going show that Q is also a right 
inverse. We do this for the transforms Q c and Q v separately. First a preliminary result. We 
denote by (f,g)k;n the limit of the truncated inner product lim^ TO _). 00 (/, g)k,i-,m,m provided 
that this limit exists. 

Lemma 5.5. Let 71,72 G C* such that /i( 7 i) 7^ M72); ^ en f or <$> e ^(71) anc ^ ^ e ^(72); 

Proof. Functions in V^, /x G C, are continuously differentiable at the origin, therefore 

lim D{<p,^){z±q l ) = 0. 

Since and ?/> are eigenfunctions of L for eigenvalue /i( 7 i), respectively ^(72), we obtain 
from Proposition 12.31 

(/i( 7 i) -M72))(0,^)fc;n = DiMKz+q"- 1 ) - D{ct>^){z.q k - X ). □ 

We are going to apply the previous lemma to the functions y? 7 , <p* and which are 
functions in V^m by Propositions 13.71 and 13. 101 The following lemma will be useful. 

Lemma 5.6. For k — > 00, 

D(*± , $± ) (a^-*) = (71 - 7 2 )^ 2± (7172)^ (1 + 0(9 fe )) • 

Proof. This follows from the definition of the Casorati determinant (12.21) . and from the 
asymptotic behavior of 3>~(a?) and u(x)/x for large see (13.51) and Lemma [2741 See also 
the proof of Lemma 13.31 □ 

As a consequence we obtain the following orthogonality relation. 
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Lemma 5.7. Let 7 G T and 7' G T, then 

(^ 7 ,$+> £2 = 0, (^t,$+) £2 =0. 
Proof. From Lemmas 15.51 15.61 and the c-function expansions from Proposition 13.41 we find 
(<^,$+> £2 = lim (c z+ ( 7 )($+$+)^ + c, + (l/ 7 )($+ =0, 

r£ )Tl — ^ — OO 

since |7'| < 1. In the same way it follows that (if^, &^)c 2 = 0. □ 

We are now ready to show that Q p is a partial right inverse of the map T . 
Proposition 5.8. The map Q p : 7i p — > F(W q ) satisfies 

(G P 9i, Sp92)c 2 = (91, 92)h p , 9i, 92 e H p . 

Moreover, for g G Tip we have T(C) v g) = + 9 in TC, where denotes the zero function 
in 7i c . 

Proof. Let g, h be finitely supported functions in 7i p . Then we find from Corollary 14. 8[ 
(G P 9,Gph) £ *= I (^^(7)^(^iV(7))(X; /i (T')^y(^)^(T , ))^(^)^ 

= ^ (<|.+,$+) £2^? (7)MY)iV(7)iV(7 , ) 

7,7'gr 

= J2g(i)W)N(i) = (g,h) np . 

In order to prove the identity T{G P g) = + g, we split this identity into three different 
cases: 

FpiGpg) = g, F c {G v g) = and T\{G P g) = 0. 

The identity T v {C) v g) = g is proved in a similar way as in the proof of Proposition 15.41 
and the other two identities follow from Lemma 15.71 Since the set of finitely supported 
functions is dense in TC P , the proposition follows. □ 

Next we are going to show that G c is also a partial right inverse of T . For this we apply 
a classical method used by Gotze [H] and by Braaksma and Meulenbeld |3] for the Jacobi 
function transform. 

We define for 7 G T, 



«i (7) = ui(r,a,b,c,d; z-,z+\q) = K z+ c z+ (7)0^(1/7) - K z _ c z _ (7)0^(1/7), 
1*2(7) = ^2(7; a, b, c, d; z_, z+\q) = K z+ c z+ (7)^(1/7) - (7)4_(1/t)- 
Explicitly, using the expressions for c z and we have 

(1 - q)(s'j ±1 ,cq'y ±1 /as,dq'y ±1 /as]q) 00 



(5.2) 



«i(7) 



x 



(cg/a, cg/a, dg/a, dg/a, 7 ±2 ; q)oo6(bz +1 bz-, cz +} cz-, dz + , dzS) 
(z + 9(az + , bz^, cz__, dz__, bsz + ^j ±l ) — z_9(az^, bz + , cz + , dz + , bsz^^ 1 )^ . 
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For U2 we have 

u ( ) - £ ~ ^ 7±1; cg / ag7 ' cgT/fe, dq/as-f, dq/bs; q) c 
as (cq/a, cq/b, dq/a, dq/b,^ 2 ; q)^ 

9(bsz-j, asz^/qj) 9(bsz + r j, asz + /q^) 
9(cz_,dz_) 9(cz + ,dz + ) 

Using the ^-product identity fll.il) with 



x = z_e 



bs^fe 



-i(n+S)/2 



where c = \c\e tK and c? = | cZ | e** 5 , we obtain 

(s^ ±1 ,cq'y ±1 /as,cq'y ±1 /bs,dq'y ±1 /as,dq'y ±1 /bs-,q) 00 9(z^/z + ,cdz^z + ) 
M-T) = Ml - q) ( Cg/a , cq/b , dq/a, dq/b, 7^ dZ) " 

Observe that m 2 = ?4 and ^2(7) = -u 2 (l/7), and that U2 is real- valued onT\{ — 1,1}. 
Let C (T) be the set of functions defined by 

Co (IT) = : T -»• C I g is continuous, #(-1) = g(l) = 0, #(7) = #(1/7)}. 

Proposition 5.9. Lei g G Cq(T) an<i /et 7' G T \ { — 1, 1} ; ^en 

lim ~t~~t /" g(-f){(p y ,^) k . n — = g{i)ui{i), 

lim / g{i){vLw)k;n— = g{i)u 2 {i) 

fc,n->- oo 47TZ J T ' 7 

Proof. We prove the first identity in the proposition, the second identity is proved in the 
same way. Let us fix a g G Co(T), and let us define 

z V ; 2n J yK J 2cos(#) -2cos(0') 
From Lemma 15.51 we find 



where 7' = e ie ' with 0' G (0,7r). We see that we need to investigate the limit of I™(9') 
when m — > 00. Using the c-function expansion from Proposition 13.41 and Lemma [5.61 we 
obtain, for large m, 

X, 



2V 7 2tt 

^£{-1,1} 

where 

( e *fl _ e^') e *(™-i)(^+^') C2 (^) Cz ( r/ ^') 



2cos(fl) -2cos(0') 

Since 0^(7) is continuous on T\{— 1, 1} the functions ip™, considered as functions of 9, are 
continuous on (0, it) \ {9'}. We see immediately that ij)™(9, 9'; 1, 1) and ip™(9, 9'; —1, —1) 
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have a removable singularity at = 9'. Now by the Riemann-Lebesgue Lemma the terms 
with these two functions vanish in the limit, and this leaves us with 



lim r z 



lim — - 

m^oo 2,71 



g(e w ) (^ m (0, 6'; 1, -1) + W(0, 9'; -1, l))d9. 



Here we applied dominated convergence to get rid of the 0(g m )-terms. Using the identity 
cos(a) - cos(/3) = 2 sin(^) sin(^) we find 



CW;i,-i) + ^ m (M';-M) 

l 



4s in(^) sin(^) 



ie \r (J9'\J(™-lW-6)(-i8 _ iff* 



+ c z {e )c z (e e 



4sin(^) sin(^) 



TV ( [c z (e- i6 )c z (e i9 ') - c z {e^)c z {e-^)}e^-^ d '- e \e^ - e") 



+ c z (e* y )c z (e-*»)ij m (6,6>) 



(5.3) 



where 



^(9, 9') = e «™-iw-e)( e -ie _ ^ + j{ m -w-v)( e * _ e -W) 

= 2 cos (m9 - (m - 1)9') - 2 cos ((m - 1)0 - m9') . 

The first term in (15. 3p has a removable singularity, so by the Riemann-Lebesgue Lemma 
this term also vanishes in the limit, and now we have 



lim I[ 

TO^OO 



lim — - 

m— >oo 2lX 



g(e^)c z (e ty )c z (e 



-iff 



ip m (9,9') 



4sin(^)sin(^) 



j^dO 



lim / g(e i(, )c z (e*)c z (e-*)D m (0;0')dO, 

m— >oo /7T 



where D m (9; 9') is the Dirichlet kernel 



D m {0;ff) 



sin ((m-f) (0-0')) 



sin (|(0-0')) 

From the well-known properties of the Dirichlet-kernel we obtain 

lim If (0') = K^(e^)c,(e^)c,(e^'), 



j-mfQi 

m^oo 

and from this the result follows. 



□ 



Proposition 5.10. Let g 1 , g 2 £ C (T) and let 7' G T \ {—1, 1}, then 



ipy(x) 



t w(x)dgX = 11(7') 



ViWV/ftl^ ^7 
4vri 7 T V</4(^)/ \</a(7)/ 7 

where u zs t/ie matrix-valued function onT\ { — 1, 1} defined by 

, \ ^2(7) Mi(7) N 
7 ^ 11(7) - ' 



* ^i(Y) 



#2(7') 



WH7) "2(7)/ ' 
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Proof. Let g%,g2 £ C (T) and 7,7' 6T\{-1,1}. From Proposition 15.91 we find 
^(tOuiCtO = lim / £2(7) ( / <p~,(x)ipy(x)w(x)d q x) — 

7r, V4m </T 7 y 

To justify the interchanging of the order of integration, we note that it follows from the 
explicit expressions for <p 7 (x) and w(x) that 

if 1 (x)ify(x)w(x) = 1 + 0(q m ), x = z±q m -> 0, 

so that the sums 

00 

m=n 

both converge uniformly on T \ {— 1, 1}. In the same way we find 

^(YWy) = f v\'( x ){^— f 92(l)^(x)—^w(x)d q x, 



gi{l')u\{i)= I ip\,(x)(^-. [ 9i(lW\(x)—^jw(x)d q x, 



7 
f/7 

V47ri Jj^^^ ,/r 7\ 1 ry 
9i(l')Ml') = f <pA x )(j-- f 9i(l)v\(x)—)w(x)d q x. 

Now the proposition follows. □ 

The matrix-valued function u has the following useful property, which is proved in the 
appendix. 

Lemma 5.11. For 7 G T \ { — 1, 1}, 

u( 7 )" 1 = v(7). 

We define 

C (T; C 2 ) = \g = ( 9l ) 9l , g 2 E C (T) } C H c . 



.92. 

We are now in a position to show that Q c is a partial right inverse of T. 
Proposition 5.12. The map Q c : 7i c —>■ F(M. q ) satisfies 

{Gc9i, Gc92)& = (gi, g2)n c , gi, g2 e H c . 

Moreover, for g E H c we have J-{G c g) = g + in H, where denotes the zero function 
in Hp. 

Proof. Let 7' E T\ {-1, 1}, let g {1 \g {2) E C (T) and define # = (j^Y Since v u v\ and 
f 2 are continuous on T, both components of the C 2 -valued function 



7 >-> v(7) 



^(2)( 7 ) 
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are in Cq(T). Now by Proposition 15.101 and Lemma [5.111 we have 




Moreover, for 7' G T, 




G?7 



7 



by dominated convergence and Lemma [5. 71 This shows that T{Q c g) = g + in 7i. 
Let <7i,<72 G Co(T 2 ), then it follows from Proposition 15.21 that 



Collecting the results of this subsection we come to the main theorem. 

Theorem 5.13. For (a,b,c,d) G P, the map T ' : C? — > W zs an isometric isomorphism 
with inverse Q . 

Proof. Let (a, 6, c, d) G P gen . Combining Propositions 15.81 and 15.121 gives TQ = idft. 
Together with Proposition 15.41 this leads to the theorem. By continuity in the parameters, 
the result holds for all (a, b, c, d) G P. □ 

Corollary 5.14. The set {^(x, •) | x G M g } forms an orthogonal basis forTi with squared 
norm \\^{x, ■)\\\ L = w{x)^ 1 . 

Proof. This follows from Lemma 15.31 and Theorem 15.13} since the functions f y defined in 
Lemma [5.31 form an orthogonal basis for C 2 with squared norm w(y)~ l . □ 

Remark 5.15. The Hilbert space TC and the inverse Q of the vector- valued big g-Jacobi 
function transform depend essentially on five parameters, namely az_, 6z_, cz_, dz_ and 
z + /z- 

5.2. An equivalent integral transform. For / G T>^ n and 7 G V we have (J 7 f )('-/) = 

(/, $^)£2. Since the function <E>+ can be expressed in terms of big g-Jacobi functions by 
Proposition 13. 101 we can define an integral transform with only the big g-Jacobi functions 
ip 1 and tplj as a kernel, which is equivalent to T . This new integral transform can of course 
also be extended to an isometric isomorphism. We only state the result here, and we leave 
the details to the reader. 

For / G Pfi n we define an integral transform J that is closely related to the vector- 
valued big g-Jacobi function transform T by 



For (a, 6, c,d) G P we define an inner product on the vector space of C 2 -valued functions 



(gi,92)n e = (91 + 0,02 + 0) n = (F(G c gi),F(G c g2))<H = (G c gi,G c g2)c^ 
Since the set C (T;C 2 ) is dense in TC C , the proposition follows. 



□ 




by 




7er 
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Here v p ( 7 ) is the matrix- valued function on T given by 

7 Vp(7) " U*(7) ^(7) J ' 

where the matrix coefficients i>i, p ( 7 ) = fi, P ( 7 ; a, 6, c, d; z_, i = 1, . . . , 4, are defined 

as follows: 

For 7 G T inf U Tf; s , ^ 4)P ( 7 ) = ^ p ( 7 ), ^ 3)P ( 7 ) = *; 2 , p ( 7 ), and 

t**(7) = <(7)J%), 
^, P (7) = 4 + (7)4 + (7)iV(7). 
For 7 G rS /M U rf, ^ p ( 7 ) = ^ p ( 7 ) = 0, and 

0, if a = 6, 

M7)) 2 

■ ^ , ifa = J, 

v 2 M = { c z+ {j)cl + {j) 

0, ifa^fc. 

Recall here that rjj^ aa is only non-empty if a 7^ 6. Now denote by M. = M(a, b, c, d; Z-, z+\q) 
the closure of the set 



span 



I 7 Vri(*)/ 



x e Kg 



with respect to the norm || ■ ||^v). Note that a function g E M. satisfies rg = g. 
Let 6 : M — > be the operator defined by 

( 5(7), 7 e T, 

(e ff )( 7 ) = \ (4 + (7) <(7))5(7), 7 g r inf u r fi ; s , 
[(c 2+ ( 7 )- 1 0)3(7), 7erfur^ /as , 

then 

{ < S>9i,&92}n = (9i,92)m, 
for functions ^ G .M, i — 1,2. In particular, we have 

( e (^tS))w = *(^7), 7 eTur, 

so 9 : M. — > 7i is an isomorphism. Also, JF/ =(60 J")/ for / G £>fi n . 

Theorem 5.16. The map J : T>^ n — > .M extends uniquely to an isometric isomorphism 
J ext : C? ^> M.. Moreover, X = Q o Q : J\A ^ C 2 is the inverse of J ext . 

Remark 5.17. (i) Let / G C? be a function for which Tj can be written as an integral 
transform, i.e., 

(•?7)(7)=/ /(x)*(x, 7 )«;(x)d,x, 7 G T U T. 
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Then J eyLt f can in general not be written as the integral 

f( x ) ( ^tAl w{x)d q x ) 
when / G" Pfln, since the integrals in the components of this vector might be divergent for 

7 6 r. 

(ii) The inverse X of J eyit can be given explicitly by 

< x »™ = ('• (S) ) M ieR - 

for all g G M. for which the above inner product exists. 

(iii) Like J 7 , the map J7" cx t diagonalizes L; 

(J cxt oLoJ c -l)g = Mg, 
for functions g G M. such that Mg G A4. 

Appendix A. 

In this appendix we prove Lemmas 14.21 and 15. Hi 

A.l. Proof of Lemma 14.21 We prove the following statement: 
For x,y el, and 7, 7 _1 G S TCg \V we have 

u(l/7) u(7) 

wi(7)y? 7 (x)^ 7 (?/) + 1^(7) (^ 7 (x)^(y) + y?t (a:)^ 7 (y)) + v}(7)v 7 (a0v4(y) 



7 - I/7 
w/iere 

(cq/ a, dg/a; q) 2 00 6(bz + , bz_) 



^1(7) 



^2(7) 



(1 — g)afolz+0(2_/£ + , z + /z_, a/b, b/a) 

x (7 ±2 ;g)oo 

(s7 ±:L , cqj^/as, dqj^/as; g) 00 6'(s7 ±1 , a6sz_2; + 7 ±1 ) 

x ^2:_0(az + , C2; + , dz + , bz_, asz_7 ±1 ) — z + #(a,2_, cz_, dz_, bz + , asz + ^ ±l ) 

(cq/a, dq/a, cq/b, dq/b; q) 00 6{az +) az^, bz + , bz~, cdz-Z + ) 
abz 2 _z + (l — q)9(z + /z-, a/b, b/a) 

(7 ±2 ;g)oo 



(s7 ±1 ; g) oc 6 l (s7 ±1 , absz_z + ^ ±l ) 



Proof. Let 7, 7 1 G S reg \ V. Note that S po \ C V, hence 7, 7 1 G" <S po i. We define 

_ $r /7 (*K/ 7 (y) ^(x)*+(y) 
" [X,V) «(l/7) «(7) ■ 

Using </> 7 = </?i/ 7 and Proposition 13. 101 we see that 

J 7 (x, = ^(7V 7 (a;V 7 (?/) + v' 2 (7) <^ 7 (x)^ 7 (y) + u£(7)y> 7 (zV 7 (2/) + ^^(x)^?/), 
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d z _ 


(l/ 7 )4 + (l/7) 


d z _{j)d z+ (7) 




v{l/l) 


f(7) 


d z _ 


(1/7)4+ (1/7) 


4_(7)4 + (7) 




«(l/7) 


f(7) 


4.(1/7)^(1/7) 


4_(7)4+(7) 




u(l/ 7 ) 


f(7) 


4_ 


(1/7)4,(1/7) 


4_ (7)4,(7) 




v{l/i) 


u(7) 



«i(7) 
^(7) 
^(7) 
^4(7) 



Since v (7) = ^(7), it is immediately clear that ^ (7) = ^4(7) and v' 2 > (7) = ^3(7). 

Using the explicit expressions for d 2 ( 7 ) and u( 7 ), see Proposition 13.101 and Theorem 
13.131 we find 



4(7) 



bs(cq/a, dq/a, cq/b, dq/b; q) 00 6(az +) bzJ) 
q(l-q) (S7, s/j; q) 00 6(z_/z + , a/b, b/ a) 

9(q 2 /asz-'y, q/bsz + ^) Q(q 2 l j 'asz-, q^/bsz + ) 
0(s 7 , q 2 /absz^z + j) #(s/7, q 2 ^ / absz_z + ) 



From this we find the expression for 1*2(7) = (7 — 1/7)^2(7) gi ven m the lemma after 
using the ^-product identity (11. ip with 



x 



iqe 



-ia/2 



az- 



v = i^e 



-ia/2 _ 



az. 



w 



iqe %a l 2 


/ * 


bsz + y 


az_ 


ie' ia ' 2 / 


q 


7 V 


az^ 



where a = |a|e m . 

Next we compute ^1(7) = (7 — 1/7)^1(7); 

(cg/a, dq/a; q) 2 oo 0(bz + , bz_ 



72+ (1 - q)(sj,s/j; q) oo 0(z^/ z + )9(a/b) 2 

7 2 (077/65, dq^jbs; q) 0O 6(q 2 'j/asz + , q 2 ^/aszJ) 
(cqj/as, dq'j/as; q) QO 0(s/-f, qsj / 'cdz_z + ) 

__ {qc/bs'y, dq/bs'y; q) 00 6(q 2 /'yasz + , q 2 /^asz- ) 
(cq/asj, dq/adj; q)oo9(sj, qs / 'cdz-Z+j) 

Since cq/as = bs/c, the expression between large brackets can be written as 

-7 



(cg7 ±1 / as 5 dq^ 1 /as; q) oc 8(s / y ±1 , cdz-Z + ^ ±l / s) 
x Cy^O^asz^/q, jasz+fq, dq/sbj, cqj sbj, s/7, cdz_z + /s-y) 

— / y6(asz_/q / y, asz + /q^, dq^/bs, cq^/bs, 37, cdz_z + / y / s) ). 



(a.i; 
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We use the ^-product identity [HJ Exer.5.22] 

-9(tx/p, ux/p, vx/p, wx/p, y/p, y/r,r/p) 9(ty/p, uy/p, vy/p, wy/p, x/p, x/r, rip) = 

y x 

I x 

—6(tr/p, ur/p, vr/p, wr/p, x/p, y/p,y/x) 9(t, u,v } w,r/x,r/y } y/x) } 

y pr 



with parameters 



q q q q 
p= , r = , t= , u = . 

asz + asz- az + cz + 

9 h 1 

w = bz_, x = — , y = 7, 



then (lA.ip becomes 



dz + 7 ' 



-0( 7 2 



(cg7 ±1 / as 5 dq^ 1 /as; q) 00 9(s'y ±1 } cdz-Z^^ 1 / s, z+/z~) 
x (^9(q/az_, q/cz-, q/dz-, bz + , asz+j^ 1 / q) 

^ 9{q/ az + , qj cz + , qj dz + , bz_ , q^ ±l / asz_)J . 

The expression given in the lemma is obtained from this after using the identity —x9(qx) = 
9(x) several times. □ 

A. 2. Proof of Lemma 15.111 We show that 

u( 7 )- 1 = v( 7 ), 7 eT\{-l,i}, 

with 

U[1) U( 7 ) « 2 (7V' [V U(7) Ml))' 

Proof. By a direct verification, using the explicit expressions for v% and v 2 from Lemma 
14.21 (see also Appendix lA.lj) . and for u\ and 112, one sees that 



where 5 (7) is the function given by 

(1 — q) 2 z 2 _z 2 + ab9(z-/ 'z+, z+/z-, a/b, b/a) 



5( 7 ) 



x 



(cq/a, cq/b, dq/a, dq/b; q)l c 9(az_, az + , bz_, bz+, cz^ } cz + , dz_, dz + , ) 

(s7 ±:L , S7 ±:L , cq^ 1 /as, cqj^/bs, dqj^/as, cqj ±1 /bs) 00 9(s , y ±1 , absz_z + 'y ±1 ) 



)oo 



It remains to show that 5(7) is the determinant of the matrix 11(7). 
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Using the definition (15.21) of the functions u\ and U2, and U2 = u\, the determinant of 
u(7) becomes 

det (u(7)) =4(7)^2(7) - 4(t)«i(t) 

=K Z _K Z+ (c 2+ ( 7 )c 2+ (1/7)4 (7)4_ (1/7) - c z+ (7)4 + (l/7)4_ (7)c 2 _ (l/ 7 ) 

+ 4 + (7)4 + (V7K_(7K_(l/7) - 4 + (7)^ + (l/7)c,_(7)4_(l/7)) 
=i^_i^ + (c z+ ( 7 )4_ (7) - 4 + ( 7 )c z _ ( 7 )' 

x (c 2+ (l/ 7 )4„ (1/7) -4 + (l/7K_ (1/7))- 
Explicitly, we have 

t f (s/7, s/7, eg/as"?, cq/bs'y, dq/as'y, dq/bs'y; 9)00^(7) 

c z+ {l)c z _{l) c 2+ ( 7 jc 2 _( 7 J - (^^^^^^.^j^^^fe^^)' 

where 

^(7) =6*(as2;_7, bsz+'j, bz_, az + ) — 9(asz + r y, bsz-j, bz + , azJ) 
=bz + 9(z_/z + , a/b, 57, a6sz_^ + 7). 

See the proof of Theorem 13.131 for the last equality. By inspection it follows that indeed 
5( 7 ) = det (11(7)). ... ^ 
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